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Abstract 

We discuss example of an elementary cellular automaton for which the density 

of ones decays toward its limiting value as a power of the number of iterations n. 

^ ' Using the fact that this rule conserves the number of blocks 10 and that preimages of 

r? ■ some other blocks exhibit patterns closely related to patterns observed in rule 184, we 

^r^ , derive expressions for the number of n-step preimages of all blocks of length 3. These 

expressions involve Catalan numbers, and together with basic properties of iterated 

probability measures they allow us to to compute the density of ones after n iterations, 

. as well as probabilities of occurrence of arbitrary block of length smaller or equal to 3. 

o 



1. Introduction 

A question of interest in the theory of cellular automata (CA) is the action of the global 
function of a given cellular automaton on an initial probability measure. Typically, one 
starts with a Bernoulli measure and wants to determine the measure after n applications 
of the CA rule. More informally, we start with an initial configuration where each site is 
(in the case of binary rules) equal to 1 with probability p and equal to with probability 
1 — p, independently for all sites. Then we ask: after n iterations of the CA rule, what is 
the probability of occurrence of a given block b in the resulting configuration? The simplest 
question of this type is often phrased informally as follows: what is the density of ones p„ 
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after n iterations of the CA rule over a "random" initial configuration with 50% of zeros and 
50% of ones? Here by "density" one understands the probability of occurrence of 1. 

It is usually very hard to answer questions like this rigorously, and quite often one has to 
resort to numerical experiments. Such experiments reveal that for many cellular automata, 
pn exponentially decays toward some limiting value poo- In physics this is sometimes called 
"exponential relaxation to equilibrium" . Other types of relaxation to equilibrium, such as 
power law decay toward pao-, are less common in CA, and to our knowledge, no such case 
has ever been discussed rigorously in the CA literature. 

In this paper we demonstrate that in the elementary CA rule 14 the decay of pn toward 
its limiting value follows a power law. We show that the origin of this power law is the 
scaling of the numbers of n-step preimages of certain finite blocks. The precise numbers 
of preimages of these blocks can be expressed in terms of Catalan numbers, similarly as 
previously reported for the rule 184 [1]. For large n, one can approximate Catalan numbers 
via Stirling formula, obtaining as a result the power law p„ — p^ ~ n~^/^. 

The paper is organized as follows. Following basic definitions, we present a theorem on 
enumeration of preimages of basic blocks in rule 14. The poof of this theorem requires four 
technical lemmas, which are proved in sections following the proof of the main theorem. 
The formula for density of ones is then proved using the enumeration theorem, and the 
asymptotic power law is derived. 

2. Basic definitions 

Let Q = {0, 1, ...A^ — 1} be called a symbol set, and let S{Q) be the set of all bisequences 
over Q, where by a bisequence we mean a function on Z to Q. Set S{Q), which is a compact, 
totally disconnected, perfect, metric space, will be called the configuration space. Throughout 
the remainder of this text we shall assume that Q = {0, 1}, and the configuration space 
<S{Q) = {0, 1}^ will be simply denoted by S. 

A block of length r is an ordered set 6o^i • • • &n-i, where n G N, 6j G ^. Let n G N and let 
Bn denote the set of all blocks of length n over Q. The number of elements of i3„ (denoted 
by card Br) equals 2". 

For r G N, a mapping / : {0, Ij^'^+i |_^ |q^ j^ j ^m i^q called a cellular automaton rule 
of radius r. Alternatively, the function / can be considered as a mapping of B2r+i into 
B, = G = {0, 1}. 

Corresponding to / (also called a local mapping) we define a global mapping F : S ^ S 
such that {F{s))i = f{si-r, . . . , Sj, . . . , Si+r) for any s E S. The composition of two rules /, g 
can be now defined in terms of their corresponding global mappings F and G as {FoG){s) = 
F{G{s)), where s e S. 

A block evolution operator corresponding to / is a mapping i : B ^—>- B defined as follows. 
Let r G N be the radius of /, and let a = aoOi . . . «„-! ^ Bn where n > 2r + 1 > 0. Then 

f (a) = {f{ai, a^+i, . . . , a^+2r)}i~t~^ ■ (1) 

Note that if 6 G B2r+i then f{b) = f (6). 



We will consider the case oiQ = {0, 1} and r = 1 rules, i.e., elementary cellular automata. 
In this case, when 6 G i33,then/(6) = f(6). The set iSg = {000,001,010,011,100,101,101,110, 
111} will be called the set of basic blocks. 

The number of n-step preimages of the block b under the rule / is defined as the number 
of elements of the set f~"(6). Given an elementary rule /, we will be especially interested in 
the number of n-step preimages of basic blocks under the rule /. 

3. Rule 14 

Local function of the elementary cellular automaton rule 14 is defined as 



/(xo, a;i, 0:2) = Xi + X2 + a;ia;oa;2 — 0:1X2 — X0X2 — XiXq. 



(2) 



This means that /(0,0, 1) = /(0, 1,0) = /(0, 1, 1) = 1, and /(xo,Xi,X2) = for all other 
triples (xo,Xi,X2) G {0,1}^. 

Preimage sets of basic blocks, that is, sets f~"(6) for b G B3, have rather complex structure 
for this rule. Figure 1 shows, as an example, preimages f~"(6) for b = 101 for n = 1,2,3. 
Preimages are represented in the form of a tree rooted at 101. Preimages f~^(101) are 01010, 
01001, and 01011, and they are shown as the first level of the tree, f~^(101) as the second 
level, and f~^(101) as the third level. When one block a is the image of another block b, 
that is, f (6) = a, an edge from a to 6 is drawn. 

In spite of the apparent complexity of sets f~"(6) for basic blocks b, it is possible to 
determine cardinalities of these sets. 

Theorem 3.1. Let f be the block evolution operator for CA rule I4. Then for any positive 
integer n we have 



card f~" (000) 
card f ""(001) 
cardf-"(010) 
cardf-"(011) 
card f""( 100) 
card f ""(101) 
card f""( 110) 
cardf""(lll) 



(4n + 3)C„, 

22"+i_(2n+l)C„, 

2(n+l)C„, 

22"+i_2(n+l)C„, 

22"+i_(2n+l)C„, 

(2n+l)C„, 

22"+i_2(n+l)Cn, 

0, 



where Cn is the n-th Catalan number 



Gr, 



2n 



2n 
n 



(2n)! 



n!(n + 1)!' 



(3) 



Proof of this theorem will be based on the following four lemmas. 
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Figure 1: Preimage tree for the block 101 for rule 14. 

Lemma 3.2. Let 

fiS'i{xo,xi,X2) = xo + xia;2 - xixo, (4) 

/i95(a;o,a;i,a;2) = 1 - Xi - Xq + 2xia;o (5) 

for xq, Xi, X2 G {0, 1}. Then if Xq, Xi, X2, x^, X4 G {0, 1} and at least of one of xi, X2 is equal 
to zero, we have 

fl95{fl4{Xo,Xi,X2)Jl4{Xl,X2,X3),fu{x2,X3,X4)) = (6) 

/l84(/l95(a^0 5 a^l, 3^2), /l95(a;i, X2, X3), /l95(x2, X3, X4)) 

Lemma 3.3. For any n G N, the number of n- step preimages of 101 under the rule I4 is 
the same as the number of n- step preimages of 000 under the rule 184, that is, 

card ff/ ( 101 ) = card ffg^ (000) , (7) 



where subscripts 184 ^^'^ H indicate block evolution operators for, respectively, CA rules 184 
and 14- Moreover, the bisection M„ from the set f{^4(000) to the set f{^"(101) is defined by 

Mn{xoXi ...Xm) = lu + j + l + ^Xi mod 2 

I j=0 J j=o 

for m G N and for XqXi . . . x^ G {0, l}*". 
Lemma 3.4. For any n E N, we have 

card ff/llO) = card fr4"(01) = 4". (9) 

Lemma 3.5. For any n E N , 

fr/(ioi) = i?[i?[fr4"-^(oio)]], (10) 

where R is the right truncation operator defined as -R(&o^i • • • &n) = &o^i • • • ^n-i- 

4. Proof of the main theorem 

We will prove the theorem first assuming validity of all four lemmas. Proofs of lemmas will 
be presented in section O 

Since Lemma [3.31 implies that sets f{^4(000) and f]^"'(101) have the same cardinality, and 
since it has been shown in [1] that 

cardffg^lOOO) = {2n + 1)C„, (11) 

we immediately obtain the desired result cardfj^"(101) = {2n + 1)C„. 
Lemma 13.51 immediately yields 

cardr"(010) = 2{n + 1)C„. (12) 

Since by definition of f, cardf~"(101) + cardf~"(100) = 2cardf~"(10), we obtain 

cardf-"(100) = 2cardr"(10) - r"(101), (13) 



and using Lemma 13.41 

cardf-"(100) = 2^"+! - (2n + 1)C„. (14) 

Similar argument leads to 

cardf-"(001) = 2^"+! - {2n + 1)^. (15) 

The formula for cardf~"(011) can be obtained by observing, again from the definition of 
f, that cardf-"(011) + cardf-"(010) = 2cardf-"(01), and by using Lemma [33 Proof of 
the formula for cardf~"(110) is similar. 



Thus, the only cases which we are missing are 000 and 111. The case of 111 is a direct 
consequence of the fact that the block 111 has no preimages under CA rule 14, which can 
be easily verified by direct computation. 

The last case, formula for cardf~"(000), follows from the fact that 

J2 cardf-"(6) = cardi32n+3 = 2^"+^ (16) 

beBs 

This yields 
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cardr"(000) = 2^""+'^ - ^cardr"(A) = {An + 3)C„. (17) 



i=l 



5. Proofs of Lemmas 

5.1. Proof of Lemma 13.21 

Using definitions of /195, /14, and /i84, we obtain after simplification and after using x"^ = x 
for X G {0, 1} the following expressions: 

/l95(/l4(2;05 2:1, X2), flA{Xi,X2, X3), fli\X2, X3, X4)) = 

1 - xi + xia;oX2 - a;2XiX3 - xqX2 + xiXq + X2X'i + xix^ - xs (18) 
and 

/i84(/i95(a;o5 a^i, a^2),/i95(a^i5 a^2, a^s)? /i95(a^2, a^s, 2:4)) = 

1 + XiXq — X0X2 + X2X^, + X1X3 — Xs — Xi. (19) 

Subtracting the right hand side of eq ( fT9l) from the right hand side of eq (fTSl) we obtain 
xiXoa;2 — X2X1X3, which vanishes if one of xi, X2 is equal to zero. D 

5.2. Proof of Lemma ISTSl 

We need to prove that the mapping M„ is indeed a bijection from A := f]^4(000) to 5 : = 
fj^"(101). It will be enough to show that M„ is injective, that is, it has the left inverse, and 
that M„ is onto. 

Before we proceed, let us make two observations. First, note that f]^^(101) = {01001, 01010, 
01011} and fr4^(010) = {10100, 010101, 10110, 10111}. This can be verified by direct compu- 
tations. As an immediate result, we see that all elements of f{^"(101) begin with 101 when 
n is even, and with 010 when n is odd. 

Secondly, again by direct computation, note that fr84(000) = {00000,00001,00010}, 
which implies that elements of fi4g(000) always begin with 000, for any n G N. 

For m G N, define the block transformation T(xoXi . . . Xm-i) = yoVi ■ ■ ■ Vm-i such that 

r^/ M 1 if i = 0, , , 

[^^^)]^= 1^ M A 9 -f^n ^20) 

11 + Xi-i + Xi mod / if « > 0. 
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We claim that T is the required left inverse of M„, that is, (T o M){x) = x for every x E A. 
By definition of T„ we have 

^ ^ ^ "^ [l + [M(a;)],_i + [M(a;)], mod 2 if z > 0. ^ ' 

Since, as observed at the beginning of this proof, all preimages of 000 start with 0, we know 
that Xo = for all x e A, and (121]) yields [T(M(x))]j = Xj for i = 0, as required. We need 
to deal with i > case separately. By definition of M„, for i > 

i— 1 i 

[T{M{x))]i = l + n + i-l + l + ^xi+n + i + l + ^xi mod 2. (22) 

1=0 1=0 

Since a + a mod 2 = for any a G {0, 1}, eq. (l22l) reduces to [T(M(x))].j = Xj, as necessary 
for T to be the left inverse of M„. M„ is therefore injective. 

To show that M„ is onto, we need to prove that for every b E B there exists a such that 
a E A and Mn{a) = b. Let us choose some b E B and take a = T{b). Using Lemma [3.21 the 
fact that 

1 + Xo + Xi mod 2 = /i95(xo,Xi,X2), (23) 

and knowing that b starts with either 101 or 010, we can easily show that 

Tofi4(6) = fi84oT(6). (24) 

Therefore, fi84(T(6)) = T(fi4(6) = T(lOl) = 000, which shows that a = T{b) is indeed a 
member of A. Now we need to show that Mn{a) = b, or equivalently that Mn{T{b)) = b. By 

definition of M„, 

j 

[Mn{T{b))],=n + j + l + J2bi mod 2, (25) 

hence 

, , ,,, I ra + 1 mod 2 if ?' = 0, , , 

[MJT(b))], = I . ■' ' 26 

^ ^ ^ "^' \n+3 + l + Y.U{l + h-i + bi) mod 2 ifj>0. ^ ' 

Basic properties of mod 2 operation reduce this to 

r, ^ ,^,,- --, 1^ + 1 mod 2 if 7 = 0, , „, 

^ ^ ^ "^' ^n + l + b^ + b, mod 2 if J > 0. ^ ^ 

As remarked at the beginning, preimages of 101 begin with 010, while preimages of 010 
begin with 101. This means that n-step preimages of 101 under fi4 start either with for 
odd n or with 1 for even n, or equivalently, for b G f]^"(101), b^ = n + 1 mod 2. Using this 
fact, we can see that eq. ( 1271) reduces to [T(M(6))]j = 6j, which proves that Mn{a) = b and 
concludes the proof of surjectivity of M„. D 



5.3. Proof of Lemma 13.41 

Let n G N, and let x G {0, 1}^ be a periodic binary bisequence of period T G N which has 
the property that all possible blocks b of length 2n + 2 appear in one period of x exactly 
once. We say that a block b of length m appears in one period of x if there exists integer i, 
< i < T, such that bk = Xi^k for all fc = 0, 1, . . . , m — 1. 

Existence of x with the aforementioned property is guaranteed by the existence of a 
Hamiltonian cycle in de Bruijn graph of dimension 2n + 1 [21 E]. Note that the total number 
of blocks of length 2n + 2 in x is 22"+^ = 4"+^ 

Let us now iterate rule 14 n times starting with x, obtaining x'. To be more precise, if 
Fi4 is the global function corresponding to /14 defined in eq. (|2]), we take x' = F{^(x). 

Since rule 14 conserves the number of blocks 10 [1], the number of blocks 10 in one period 
of x' is the same as in one period of x. 

Among all possible blocks of length 2n + 2, exactly cardf]^"(10) produced block 10 in 
one period of x'. Thus, the number of blocks 10 in one period of x' is card f{^"(10). Because 
the number of blocks 10 is conserved, the number of blocks 10 in one period of x is also 
cardf{^"(10). Yet among all possible blocks of length 2n + 1, exactly 1/4 of all of them begin 

with 10 (the remaining ones begin with 01, 00, or 11). Thus, cardf];;4"'(10) = -j-4"+^ = 4". 
Proof for the block 01 is similar. D 

5.4. Proof of Lemma 13.51 

Let b G fi4^"+^^(010). Then f^^{b) G fr/(010) = {10100,10101,10110,10111}, and therefore 
ff4(i?2(5)) = 101. This implies R'^{b) G fiTllOl), and therefore 

R' ffr4^"^'^) C fiTllOl). (28) 



Now take a block a G f24"(101), which implies that ii^ia) = 101. For any M,f G {0,1} 
there exist u',v' G {0,1} such that f"4(a'Uf) = lOlu'v'. This implies that i^^^{auv) = 010, 
and therefore auv G fi4 (010), so that a G R'^{ii^ (010)). This demonstrates that 
f]^"(101) C R^ (fi4 j, which together with eq. fl28l) leads to the conclusion that sets 

f]^'^(101) and R^ (fi4 ) are equal, as required. D 

6. Evolution of measures 

We will now come back to the question posed in the introduction. The appropriate mathe- 
matical description of an initial distribution of configurations is a probability measure /i on 
S. Such a measure can be formally constructed as follows. If 6 is a block of length k, i.e., 
b = bobi . . . bk-i, then for i G Z we define a cylinder set 

Ci{b) = {s e S : Si = bo, Si+i = 61 . . . , Sj+fc-i = bk-i}- 

The cylinder set is thus a set of all possible configurations with fixed values at a finite number 
of sites. Intuitively, measure of the cylinder set given by the block b = bo . . . bk-i, denoted 



by fi[Ci{b)], is simply a probability of occurrence of the block b starting at i. If the measure 
fi is shift- invariant, than fi{Ci{b)) is independent of i, and we will therefore drop the index i 
and write simply fi{C{b)). 

The Kolmogorov consistency theorem states that every probability measure fi satisfying 
the consistency condition 

/i[Q(6i . . . bk)] = i2[a{bi ...bk, 0)] + fi[a{bi ...bk, 1)] 

extends to a shift invariant measure on S. For p G [0, 1], the Bernoulli measure defined as 
fip[C{b)] = p^{l — pY^-' ^ where j is a number of ones in b and A; — j is a number of zeros in 
6, is an example of such a shift-invariant (or spatially homogeneous) measure. It describes a 
set of random configurations with the probability that a given site is in state 1 equal to p. 

Since a cellular automaton rule with global function F maps a configuration in S to an- 
other configuration in 5, we can define the action of F on measures on S. For all measurable 
subsets i? of iS we define {Ffi){E) = fi{F~^{E)), where F^^{E) is an inverse image of E 
under F. 

If the initial configuration was specified by /ip, what can be said about -F^/ip (i.e., what 
is the probability measure after n iterations of F)l In particular, given a block 6, what is 
the probability of the occurrence of this block in a configuration obtained from a random 
configuration after t iterations of a given rule? 

In the simplest case, when 6 = 1, we will define the density of ones as 

p„ = (F>p)(C(l)). (29) 

In what follows, we will assume that the initially measure is symmetric Bernoulli measure 
/ii/2, so that the initial density of ones is po = 1/2- 

Assume now that for a given block 6, the set of n-step preimages is f]^"'(6). Then by the 
definition of the action of Fu on the initial measure, we have 

/^(i^r4"(C(&))) = (F>p)(C(6)), (30) 

and consequently 

Y, Ka) = {F-fx,){C{b)). (31) 

aefr/Cfc) 
If 6 = 1, and /i = /ii/2, the above reduces to 

Y, /ii/2(C(a))=p„. (32) 

aefr/Ci) 

Note that all blocks a G f{'^{l) have length 2n + 1, and under the symmetric Bernoulli 
measure, the probability of their occurrence (that is, /ii/2(C(a))) is the same for all of them, 
and equal to 1/2^"+^. This is because we have 2^"+^ of all possible blocks, and each of them 
is equally probable, so a single one has probability 1/2^"+^. As a result, we obtain 

p„ = 2-2«-icardff/(l). (33) 



In rule 14, preimages of 1 are 001, 010, and Oil. We can therefore write 

Pn = 2-2"-^ (card fri"-^) (001) + fri"-^^(010) + fri"-^)(011)) . (34) 



Using formulas of Theorem 13.11 this yields 

p. = 2-2-1 ^4n _ (2n - l)a_i) = 2 (l - ^^^"-1 j • ^35) 

Using Stirling's formula to approximate factorials in the definition of C„_i, after elementary 
calculations one obtains asymptotic approximation valid for n — > oo, 

1 1 -i 

Pn ~ ^n 2- 36) 

^ 2 4v^ ^ ' 

Very similar calculations can be performed for other block probabilities. Defining the 
probability of occurrence of a block 6 in a configuration obtained from the random initial 
configuration after n iterations by P„(6) = (^"7x1/2) ((^(6)) we obtain 

Pn{b)= Yl /^1/2(C(«))- (37) 

aef-"(6) 

If the length of block b is denoted by |6|, its n-step preimage has length |6| + 2n. Again, 
since all blocks are equally probable in /ii/2, a single block of length |6| +2n has probability 

2-\b\-2n^ and we obtain 

P„(6) = 2-1^1-2" card ff/ (6). (38) 

Since cardinalities of blocks of length up to 3 are known, the above result together with 
formulas of Theorem 13.11 can be used to derive exact probabihties of blocks of length up to 
3. 

7. Conlcusions 

In closing, let us remark that rule 14 belongs to class 3 rules in informal Wolfram's classifi- 
cation. Its dynamics, while not as complicated as other class 3 rules, is far from simple. It 
is therefore encouraging to find meaningful regularities in preimage sets of this rule, and to 
be able to compute probabilities of small-length cylinder sets exactly, without any approxi- 
mations. 

One hopes that systematic analysis of properties of preimage trees of other elementary 
rules reveals more regularities of this type, perhaps leading to more general results. To 
speculate a bit, one may conjecture that rules having additive invariants (like rule 14) are 
likely to possess regularities in their preimage trees. Further investigation of this issue is 
currently ongoing. 
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